CMU Multiple-choice Question Answering System at NTCIR-11 QA-Lab
نویسندگان
چکیده
We describe CMU’s UIMA-based modular automatic question answering (QA) system. This system answers multiplechoice English questions for the world history entrance exam. Questions are preceded by short descriptions providing a historical context. Given the context and question-specific instructions, we generate verifiable assertions for each answer choice. These assertions are evaluated using several evidencing modules, which assign a plausibility score to each assertion. These scores are then aggregated to produce the most plausible answer choice. In the NTCIR-11 QALab evaluations, our system achieved 51.6% accuracy on the training set, 47.2% on Phase 1 testing set, and 34.1% on Phase 2 testing set.
منابع مشابه
Forst: Question Answering System for Second-stage Examinations at NTCIR-12 QA Lab-2 Task
Japanese university entrance exams have two stages: The National Center Test (multiple choice-type questions) and second-stage examinations (complex questions including terms and essays). We participated in all phases of NTCIR-11 QA Lab-1 and NTCIR-12 QA Lab-2 task’s Japanese subtask and our system answered all of the questions. At QA Lab-2 task, we focused on term and essay questions in the se...
متن کاملCMUQA: Multiple-Choice Question Answering at NTCIR-12 QA Lab-2 Task
The first version of the UIMA-based modular automatic question answering (QA) system was developed for NTCIR11 QA Lab task[5]. The system answers multiple-choice English questions for the Japanese university entrance examinations on the subject of world history. We made improvements in the current system by adding components focused towards Source Expansion and better Semantic Understanding of ...
متن کاملsJanta: An Open Domain Question Answering System
This paper reports on the participation of the system namely “sJanta” at NII Testbeds and Community for Information Access Research Project 11 (NTCIR-11) Question Answering (QA)-Lab English sub-task. sJanta is a modular question answering system that can answer multiple choice questions given in English natural language. We use English Wikipedia as knowledge-base. At first we retrieved Wikipedi...
متن کاملA Feature-based Classification Technique for Answering Multi-choice World History Questions: FRDC_QA at NTCIR-11 QA-Lab Task
Our FRDC_QA team participated in the QA-Lab English subtask of the NTCIR-11. In this paper, we describe our system for solving real-world university entrance exam questions, which are related to world history. Wikipedia is used as the main external resource for our system. Since problems with choosing right/wrong sentence from multiple sentence choices account for about two-thirds of the total,...
متن کاملForst: Question Answering System Using Basic Element at NTCIR-11 QA-Lab Task
This paper describes Forst's approach to university entrance examinations at NTCIR-11 QA-Lab Task. Our system consists of two types of modules: dedicated modules for each question format and common modules called by the dedicated modules as necessary. Our system uses Basic Element in order to more exactly grasp and reflect the import of questions. We also tackled short-essay questions in the se...
متن کامل